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^ A s^i lb pi in q of the literature on reading ob jidctiv< 

shows a weak sense of direction beyond elementary schools After 
assessing the profclenir the Bureau of language Arts of the Chicago 
Board of Education selected infei^ence as the focus of high-school 
reading, Ic develop taxonomy of iinf eienc^&s, the Chicago cgjumittee 
tegan inductlvelYr by writing or selecting passages or etorie.e which 
its members intuited as being increasingly difficult and appropriate 
*for the various years in high school. The texts chosen wer^ 
progressively more, d^iff icult in terms the inferences required to * 
comprehend theiB. In subsequent pilot testing, items that proved 
difficult included inferences involving judgment or emphasis; 
cuestions involving discrimination between telat^d motives Ot 
characteristics; inferences of part/whole relations-; and questions 
about the climax of the ftory^ about the relation of setting to plot, 
and ^about the function an Incident. However, it wa^ believed that 
as the ficticn reading olijectives ca(me to be the more consistent 
f opus -of teaching, the Chicago schools would see a Aarked improvement 
in reading comprehension, Too^ inferential reasoning would at least 
be one of the ' instructional^ emphaseis in Chicago.'© high school English 
courses- (HOE) • 
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Defining and Testing High 'School Reading Objectives 

In October of 1978, the Buroau of Language Arts of the Chicacp Board of 
Education d(acid®d to establish a, set of , minimum lanquago arts objoctivoe for 
Chicago's high achoolSr to create criterion referenced tests addressing 

these objectives, TJiis papet constitutes, a .p?!^iminary report on the reading/ 

V 

literature component of this project^ with special reference to its fiction 
strand. 

It shoul^not be thought that the Bureau of Language Arts had never before 
considered its high school English cvurriculum* In the general area of reading^ 
there existed seyeral studies skills guides and a^ guide for an ambitious fresh- 
miin English/course I- as well as guides for a number of sophoinQre-*^enior litera-- 
tvir^ o^ti^es on various topics or authors- However, the objectives set f orth^^ 
In felie guitles tended to be subject-matter oriente'G, and even when directed at 
Skills, as*^in the study skills guide, failed t'o establish a clear progression 
/ j^rom freshman to senior years* , 

The guides ca^\ '^hardly be blaotied for these deficiencies-: a sampling of the 
literature on reading objecti^;^es shows, in general/ a weak sense of dii^ection 
beyond ^lementary school* While descriptions of high school reading objectives 
exist/ t^h^oobjectives are not so clearly defined as to distinguish them from 
fdementary school objectives^ on the one hand, or from college English objec^ 
tiveS/ on Jthe other. And when one looks beyond individual objectives for a 
program or four. year scale of goals r one finds almost nothing* v 

Consider/ for example, some objectives from a representative guide to high 
school reading (Flanagan et al 1971), These inclyde "summarize a given para- 
graph/ showing that you understand trte main* idea, '^analyre a dociimept/ infer-^ 
ring point of viow/ intended^audience, and purpose" (this is. a "study skill")/ 
l' and ''given a selection of poetry , differentiate between those expressing sen-^ 
timent and those expressing sentimentality ^ The first, objective is olearly » 



'hi 



Dfjflnlnfj Keadlno ObjecTtivcs 

ln\portaiit 9l me«isure of comprehansiQn, However r it iu listed in pioat conipiia- 
tions of uppor elomentary languago nrts objectives ^ and^joyiy i?o taught in college 
freshman English coursas as well. As an objectlvQ, it has little b^eaning with- 
out fvirther specif ication: how^ 'Mifficulf* shoxxld th© paragraph hfr and what 
constitutes "difficulty," in this context? Is a paragraph difficult if it has 
long words and sentences? If it has an vmfjvniliar subject matter? If it is 
PQcrly written? If its structure is inexplicit? This guide does not consider 
such ^matters , a fact whiih vitiates not only the usefulness of t^^ia objective, 
but that of many others, including the Second one quoted above,, "sinalyze a 
document*" As to the third objeotive/ about sentiment an^ sentimentality, here 
the high cchool student^ Ib' asked to adjudicate a matter unsettled by literary 
critlqs to this day^ 

Another representative guide to high school reading (Dechant 1973) of f ers us 
a "typical" list of comprehension skills for high school- Some, such as 
•*a««ociate e^iperiences and meanings with grp.phic symbols," "react tojsensory 



images," "undeifstand words in- . context , " and "detect and understand main ideas"' 

would seem to apply equally well to lower elementary school, for lack of the 

I' .. * . < ' 

specification already disauscf^d. Some, such as "identify antecedents of pro- 
nouns ^" seem almost irremediably elementary school objectives, w^ile o^ers ex- 
tend into graduate school ("ipake Inferences and draw conclusions, supply implied 
details, and evaluate what is read")^ Some are exceedingly vague^{"an6w:er % ^ 
guestionj^ about a printed pf^^issage") , while others ' do. not seem to be comprehen- 
sion skills at all ("retain ideas'*) ^ though' clearly , at least shor1> term memory 
Is essential in reading. 

C<irtainly it is neither kind nor just to single out these publications for 

a » - . 

- • ♦ ' 

special blame. * Their authors are struggling through xindefined field, and I 
cite their efforts as representative / by way of illustrating the problems faceti 
by any* person or group attempting to establish objectives for a given school 
^system. Tanner's 1^71 criticism still applies t he decried "the firmest nonojc^st- 
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«tnt jii^cp'of a reading' program integral to the English curriculum," and complained 
that "to this day. thore is no generally agreed upon body of^ content and sequence 

• *»for the English curriculum in tlie ©econdary i^chool" (Tanner 1971)* 

One poi30ible source of a structural model for raoding con^rohonsion objec 
^tlves is Bloom's taxonomy of mental operations, and several authors h^ve us^ed it 
to classify reading objectives and to arrange tJiem In a hierarchical sequence- 
It will be recalled that Bloom distinguishes^ between lower and higher mental 
p"^t><?e«8e8r producing ^ix major categories, auch that each category* after the 
first useii. the skills of all the categories below it in a new constellation for . 
a irK>re complex task. The categories, briefly, are recall, ^ comprehension (trans^ 
lation, interpretation, and extrapolation), application., analysib, eynthesis, 
and evaluation (Bloom et al 1956, 1971) • Unfortunately, these categories do. nOt 
' prove very useful for structuring a reading program^ 

To ^begin with, as Bloom himself may recognize, the categories of translation, 
interpretation^ and extrapolation, or con^praheneion, are uns^iceably broad* On 
the one hand, a comprehension task m^-ghj: be to translate a line on a ^r^ph into 
a statement, or to paraphrase a sentence; on the other, it might be to ^ita t^n 
interpretatioi} of a novel. One- source gives, ate an exiiryple of a comprehension 
objective, ^recdgnize literary symbols *and explain their symbolic meanings" ^ 

(Flanagan et al'i971), while another gives "interpreting Ideas" or "olassifying 

♦ * ' * * 

*Gonvergently and divergently" (Burmeister 1974) , without specif ic context, it 

is hard to discuss these , examples. However,/An general, it wot^ld seem that the 
^pirst step in coit5>rehending a literary symbol is to recognize that a given ob- 
ject pt action ijS rueant to be symbolic, and therefore needs interpretation. If - 

the. symbol is not, like the cross, in common use, or if, like 3r<?fi!eSy or water, it 

* ■ ■ * ■ ^ 

may Have a number of conflicting meanings, the reader must proceed to consider 

the tptal context to interpret tho symbol* ' The^^e operations should, at 'the very 

l«a$t* be classified as analysis^ rather' than as the second in the hierarchy of 
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m^nt^l proceosos. If by '"interpreting ideas'^ in meant paraphrasing explicit 
statements^ .then it would seem, incited ^ to be translation^ but if it i® taken 
to invxDlva inferring an underlying idea or finding a general principle and ex^ 
plaining its jcrelations to other idoas in tl^e vork being read or in thQ ctxltural 
environment^ i then "interpret:ing ideas" may become an act^ or siynt^sis. 

The »ame argument oif overgenerality applies to the category of. "application." 
In a sense/ all reading comprehension is applications it is the application of 
systems of d^^coding to nex^ situations (t©3cts) / involving reqall of vocabulary 
and the u^e,of. concepts puch as "main ideav" How, in the context of r^ading^ 
can we distinguish application from other mental processes? The exampleft^ from 

our tfairgple text:^ are "summarize a given paragraph showing the^t you uAd^fstand 

> 

the main idea" and 'the objective involving sentimentality^- Yet summarizing 
would seem to be an activity involving analysis and E^ynthesis, whereas senti- 
^mentality matter of evaluation* 

^ When we come to ^analysis and symthesis themselves ^ we see a^ surprising ire- 

■| ■ 

veif^sal. The examples of analysis in one source include separating a statement 
into its component parts, and distinguishing fact from opinion^ its exeunples of 
synthesis include word formation. Granted that these a.cti'vities So involve 
analysis ar>d symthesis, it follows that these hi'ghet mental processes are much 
sinqpl^et thah the lower probesses of Interpretation and- application, and indeed, 

c 

may be Involved in t^em. The principle of succel36iye inclusion which underlies 

• * 
the tiiuconomy* is deni.ed^ arid the hierarchy is in disarray. .(I haye not mentioned 

the category of recall, because/ as the foregoing discussion shows, if only in- 
cidentally, few , comprehension tasks involve nothing'* irvore^^him recall'. Corrtpre- 

^ .. .< ' • . ' 

hension per se , as^, opposed to decoding, really begins^ with translation and 

application.) ^ * ' ^ ^ 

Bloom/jffiay well disagree Mth any of the attempt^ to use his categorizes to 

order readirtg objectl^$; but h^ musf^see that something is lacking in the 

definitions of cai:egories that can be given such'^^ivergent interpretations by 



Defining Kuciding Qbjectivus 

-5- 

serious students of reading ;\nd curriculunu Clearly, the problem 'of tho 
hierarchy, like that^f loc^i;lng high school r«5ading objactlves, i^ rfeloted to 
context* The categories in thV^^hiararchy , like tho objectives in most collec- 
tions, have tneaningVonly when the texts to which they are to apply are defined. 
But we lack a generally accepted description of ^jdif f lcvil€y in texts to which we 
might turn for such definitions. The various readability indices are not the 
answer. They define difficulty in terns of word length and sentence length, or 
word familiarity, and these dimensions have very little to do witt\ reading com^ 
^ 'prehension. The dif tioulty-of a jpaesage.is much more likely to be related to ^ 
Its syntax; its structure, the degree of expllcitness in the connections among 
its thought3, the familiarity of its cultural context,.^and^the amoujit of irony 
or metaphor it contains. Some of the«e dimensions are now bein^ studied by 
-cognitive .psychologists (S^tln 1978, Meyer 1975, Thojmdyke 1977, Paris 1975), 
^ ^find the rejsults are ^most interesting and suggestive, but there remains a gap 
between -the findings of. such psychologists and a coherent set of hifh>y sdhool . 
reading objective^. , 

There have, of course, been a nuiWt;>er of valualj>le efforts to create complete 
high school English programs, or programs for grjitdes 7-9: examples are the . 
Oregon curriculum and the Gateway serJ.es. Howev/er, neither of these, nor others 
known to us, met our specif iq needs: we wer^ locjking for minimal common objec- 
4 tivea and standards that could be embodied in a, 
posing a uniform selection of teatts on our very 
departments- , ^ 

Unfortunately^ it is not possible ^ to report that wp have attained this goal 
and produced ein exeit^lary set of objectives. However, we have mad^ a beginning, - 
the vfdufs of which can be assessed by the magnitude of the problem itself. This 
beginning consists in selecting inference as thje focus of high, school reading. 

^There is a growing bOdyof evidence to suggest that inference is the key 
prooees in reading comprehension, especially in the comprehension o£ conriected 



variety courses, wlth6ut im- 
c^iverse high' school English 
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diseourd^r as Ojjpoeed to Uiat of isplated oan tenets (Goetz 1977/ JUvale and 
Sohreiner 1979). This ki,nd in^ei^eno© is the process of Adding to a text 
information it *do©9 not sta^e ex^^lifcitly , but which coinpletoy tho weaning of 
vhat It does state* -^A s^iinple example cx>ine6 from the following ^netences, 
"Mary felt cold* She got i^p and closed the window.." ^ Literally/ we are not told 
why Mary closed the window, but if we are to understand these two sentences at 
all well/ we must infer that cold air was coming in through the wiT|dow, and that 
Mary knew she would'^eel warmer if that cold air were cut off. Or consider a 
mor^ difficult example i."Mary read John's letter • Suddenly,, she fe;Lt cold. She 
got up and closed the window." Here we must infer either what we had to infer 
before r or, more probably, that grohn's letter contained some news ^ which Mary 

i 

reacted emotionally, so that she felt cold, and, misunderstanding the cause of 

her feeling, closed the window, thinking that cold air was coming in. Having 

r- j 
closed the window, she will still feel cold. Thea^e examples remind on^ h6w per-- 

vaalve inference is in reading comprehension: We base these inferences 6i\ 

observed regularities in life, but also on observed regulijirities in literature 

(the syinpathe'tic heroine will not really have stolen the diAmonds) . The infer- 

ences may be needed to comprehend a sent^ance, or* two sentences together, or to 

comprehends^ such complex, but essential, matters as the focus of a story (who is 

the jprincipal character?) or of an article (what is the main problem?). Facil- 

< \ 
it-ating the abil4.ty to make these lcnger-rang6 inferences would seem to be a 

•proper goal of high school reading programs. - " ^ ' 

-> '• ■. / . ' 

Many of the objectives given in works on, high school reading dcJ relate to in- 

ferenoe, as we difine it. While finding th^ antecedent of a pronoun is not*in- 
'ferneee, by our definition, wless the sentence is ambiguous, finding 'the n»ain 
id^»a is usually a matter of inf.eronc^ (unless- the. author says/ "My main point- 
is^.,"), an,^ is especially difficult .when there are no topic sentences. Similar- 

ly^ «tfitii|g the^ purpose/ of a dooumeint usually is a matter of inference, as is 

• ' . / . ' - 

finding Supporting det/ails, and the lik*. However, though adopting the criterion 
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of complex infexence does help elirainate certain possible objectives, it doea 
not solve tji© problem of , specification alrQctdy de^cribedr that 1^5, the problem 
Of describing' the difficulty of the material on which the skill named by the 
objective is td be .performed, ^ 

Lacking a taxonomy of inferences, the Chicago committee charged with refor- 
mulating objectives decided to begin inductively, by writing or selecting 
paasage^Nor stories which its members intuited as being increasingly difficult. 




and appropriate for the various years in high school- In this matter, the com- 
roittee was assisted by its wifit, which. Kas, in part, to create a series of cri^ ^ 
terion referenced" tests to monitor achievement of the objectives- Thinking in 
terms of possible tests was- a great help in specifying levels of difficulty for 
the various .comprehension objectives. By choosing suitable text? and writing 
an Increasingly broad range of questions on these texts, the committee was able 
to apecify i'ts objectjives w^th some precision. It should, lie understood that the 
texts are not to be studied in class ^ and that €he tests are open book* In 
other words, the tests and objectives have nothing to .do with recall of any lit^ 
erary works, but set forth comprehension skills to be demonstrated on "unseen" 
text« Qf a given level of difficulty. ^ ' 

The texts* that the committee chose are progres.slvely mote difficult in terms 
of the inferences recjuired to comprehend them- The short story strand makes 
this clear. The accounts the *four stories give of what happened and why are 
less and less explicit, and the action- itself moves from the^ physical to^the.menta 
plane. Atmosphere i- thert tone, and finally ideas become factors that must be in- 
ferred to understai:id , the stories at all well. In conncectiop with tone and ideas. 
Irony is presnet and symbols or symbolic events begin to appear.. Thus the stories 
differ both in degree and breadth of inference, where by "degree of inference" .is 
meant the extent to which th^ j^nferences are supported*]^ explicit evidence, and. 
by "Jbreadth of Inference" is meant the range -Of matters (setting, motive, tone^ 
ideas) about; which infdr^nces must be made. One might think of "degree of infer- 
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•nc»" as related to the n\amb«r of intervening statements the reader must 6m)ply 
to get from onp; given to another^ The two examples about Mary and the window 
would, in this sense, invglve different degrees of inference- \ 

Re»pects in which the set st^ories do not differ may be almost as interesting 
as respects in which they differ. The stories aro not significantly different 
in length. They do not x3iffer progressively in reaidability i by the Fry index, 
they range between fifth and weventh grade levels, the senior story, "The Wall" , 
by J«an Paul Sartre, testing out as suitable for sixth grade. (So much for 
readability as an indicator of difficulty in high school level comprehension.) 
Finally, the stories do not differ progressively in familiarity of sitXiation: the 
committee wa^ looking for stories of high ihterest, rather than for •^relevant" 
or known scenes* Theoretically, it should be har.der to infer with unfamiliar 
material, but familiarity^ may need a new index, as well* Our sophomore story, 
which takes place on Mars, proved "easilr" than our junior story/ about a love 
triangle among urban teenagers . 

This, description of the set Sytories suggests how they helped to specify our 

fiction reading objectives, and what those objectives were (see appendix for 

/ ■ ^ ^ ' " 

exaitflaJjf s) * Using the traditional categorieis of setting, plot, theme, and the 

like, the test questions probe for degree and breadth of inference. For ex?im-" ^ 

p4e, a freshman^ plot question a!jks students to put- four iinportant incidents in 

their correct cfrder, whereas a senior plot question refers to an unexplained 

final response of the protagonist (he laughs) ar>d asks how tbis response relates 

to the plot as a whole- Again, a freshman setting question asKg where | the story 

tak^B place, while a senior setting question asks for the thematic (symbolic) 

4 ■ •■ ■ ^ ^ - . ■ 

significance of the setting, - 

The tests containing these questions are now being piloted in all Chicago's 
high schpols-- Preliminary field testing in a sample of classrooms in 1979 

offered some evidence that at pres^nty reading comprehension does not increase 

" ' ' . ^ ■ . •. ' ■ ^ . 

with years in high school, a finding jilso suggested, some years ago, by a high 
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. achQpX acliuinistration of t^i^ Iowa Test of Basic Skills, routinely given in 
Chicago to elementary s<ihool pupils • Of the itejns on the two forms of the 
freshman test (6/1 in all), 84% vero answered correctly by at least half the stu- 
dents* Tlxie comparable figures for the sophomore* an^ junior 'years are 74% and 
44%. The fi^uire rises to 68% for tho senior test, but this rise may be explained 
by the inclusion of honor students in the sample of seniors. The declining fig** 
ures are whAt onia would expect if, in fact, the objectives and teats increase in 
difficulty over the years^ without a coit^arable increase in the level of student^" 

preparation. In the early t^stin^rT^^ gathered no^ information on jlndtvidu^il 

' ^ ' ' ' ' ) 

student scores; the figures apply to item^, rather than student^* 

Looking at the items roost of ten-^missed, one finds recurrent patterns* All the 

items in the junior and senior tests which asked students to identify tone, to in 

terpret ironic statements, or to assign symbolic meaning proved difficult. The 

recurrent question about point of. view was « poorly answ^ed in each test, although 

It carries ' tjtie defljiition of point of view in its stem, and thus does not depend 

on recall of the concept J The inferences involving judgment or emphasis proved 

difficult: examples are questions about the "main conflict" in the s^^ory, 

questions beginning "most o£ the story is about,.." and questions abdut an ipci^ 

dent*d main revelation or a character's main motive. Similarly, questions invol-- 

ving discrimination between related motives or characteristics were poorly 

answered: students found it hard to tell whether a character was self-confident 

or gicen to insecure bluster, whether humans came to Mars to e^qplore or colonize 

it, whether Martian civilization was to be admired or regarded with Indifference, 

Which characters' were most similar in temperament (a matter vital to understand- 

ing the plot of the junior story) , which characters were most similar in outlook 

(a key to the ideas in Sartre's story). Ijfiferences of part/whole relations or 

structure also proved difficult. Questions about the climax of the story, about 

the relation^ bf setting to plot, about the function of an incident .all were poor-- 

* " ♦ ■ • 

ly' answered, 
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If on^ considers what those difficult inferences have in cx>i!\ii>on, one soes 

w - 

that they are all either inferences Based on evidence pj?osented throughout the 
Story as a whole , or over long stretches of it, or inferences based on no ex- 
pllcit statements at all. Seemingly very simple questions, euch as "what is 
the time span of the events in the etory?" or "why didn't Nancy invite Larty 
home?'* or "why ^id Pablo tell Tom the joke?" become very difficult when there 

ate no explicit cures, or when the cues are epread oVer many pages of the story 

if 

Neve^rthele^s / these are not, esoteric questions^ for all tneir difficulty; they 

are important to the undj^erstandin^ of the stories. The committed rejected all 

questions about which there were differences of opinion, as sometimes might 

arise with respect to questions about the climax of a story, the motivation of 

♦ 

Its characters, or the tone of its narration. 

Already during the current pilot testing,^ teachers^are telling us that the 

tests reveal \insuspected weaknesses in their classes' reading comprehension. 

Naturally/ the blaitie. is aqmetimes laid on the test, and we do hope to imprbve 

V ^ " .. .... 

.many of t4e items* However, thi© Bugceau of Langy^tge Arts be'iieves that as the 

fiction reading objectives — and indeed^ all the reading objectives — come to be 

the more consistent focus of teaching / Chicago will see a marked improvement in 

reading comprehension. It will not hai?e escaped the reader that in emphasizing 

• * 

\ * "I 
inference we are /saying that reading and reasoning are closely related. It 

v ■ 

seems l^-kely that at least one of the Instrjictional emphases in Chicago's high 
school English courses will be on the proce:5S of inferential reasoning as such. 
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Appendix: SMmplo pbjoctivea 

« 

4. 

Given an apptbprUto story Idofincd descriptively elsewhere, nnd by Q^cnnple In 
thtf ♦test et'ary] the ajt^donC wijll^dontlf y . / ' 

'1. the plot line in the sttj^ (order .and outcome of inpldentS).; Fr. 
t} the characters' raaln motives^ (explicit and Ithplled)-. 

' 3« . the major an^' minoi^ characters' and resetablances or paralltAs 

among them* Fr. 

» * * ■ 

4* the plot line- in the story (orijer and outcome of incidents, 

Importance or significance of incidents), Sorh., / ^ 

' 3. ;the charaiiters ^ main ^mot Ives (raos tly implied). Soph* • 

* * ■ , ■ ' ' 

6* the theme, ' Ft. - Soph* , ' • 

' ' the characters' conscious and unconscious motives/ with sope regard • 

to character developiaent. Jr. 

■ ■ . » 

e/lhe theme and its relation to a few.jsljaple symbol^ In the sbory Jr. 

• ' ^ ■ 

9. the tone of the narration. Jr. ^ 

10. point of view and it? appropriateness. Jr (Fr. -Soph, asked only 
for point of view. ) ^ ^ ^ 

lU the plot line in the story (order and outcome of Incidents. Iriportance 
• ^ or significance of the Incidents, and th.lr relation* to the. Ideas 

- in the Story). Sr. 

^ . ■ . . . • 

' 12» jaajor syrobols and their meaning. Sr. ^ 
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